Test on mARPC (Submit&Ad) Uplift Summary // 2023-08-17 20:40:59
Test on mARPC (Submit&Ad) Uplift
For key_metric mARPC (Submit&Ad):
control value = 1.34785
expeted value = 1.61742
uplift = 20.00%
for 50/50 traffic allocation we need to collect
sample_size_control: 5,569
sample_size_test: 5,569
--------------------------------------------------------------------
TOTAL SIZE: 11,138 || Approx. 7 days for daily 1,700 users
--------------------------------------------------------------------
T-Test, two-sided test
alpha = 5.00%
power = 80.00%